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Abstract 

In this paper we explore the stabilization of closed invariant sets for passive systems, and 
present conditions under which a passivity-based feedback asymptotically stabilizes the goal 
set. Our results rely on novel reduction principles allowing one to extrapolate the properties of 
stability, attractivity, and asymptotic stability of a dynamical system from analogous properties 
of the system on an invariant subset of the state space. 

1 Introduction 

The problem of stabilizing equilibrium points has been at the centre of much research in linear and 
nonlinear control theory ever since the inception of the field, and continues to receive attention to- 
day. Instead, the more general problem of stabilizing sets has received comparatively less attention. 
The set stabilization problem has intrinsic interest because many complex control specifications can 
be naturally formulated as set stabilization requirements. The synchronization problem [JJ, which 
entails making the states of two or more dynamical systems converge to each other, can be formu- 
lated as the problem of stabilizing the diagonal subspace in the state space of the coupled system. 
The observer design problem can be viewed in the same manner. The control of oscillations in 
a dynamical system [2] can be thought of as the stabilization of a set homeomorphic to the unit 
circle or, more generally, to the A:-torus. The maneuver regulation or path following problem, which 
entails making the output of a dynamical system approach and follow a specified path in the output 
space of a control system [3], can be thought of as the stabilization of a certain invariant subset of 
the state space, compatible with the motion on the path. 

Recently, significant progress has been made toward a Lyapunov characterization of set stabi- 
lizability. Albertini and Sontag showed, in [1], that uniform asymptotic controllability to a closed, 
possibly non-compact set is equivalent to the existence of a continuous control-Lyapunov function. 
Kellett and Teel in [5], [6], and [7], proved that for a locally Lipschitz control system, uniform global 
asymptotic controllability to a closed, possibly non-compact set is equivalent to the existence of a 
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locally Lipschitz control Lyapunov function (see also a related result by Rifford in [8j). Moreover, 
they were able to use this result to construct a semiglobal practical asymptotic stabilizing feedback. 

A geometric approach to a specific set stabilization problem for single-input systems was taken 
by Banaszuk and Hauser in [9]. The authors gave conditions for dynamics transversal to an open- 
loop invariant periodic orbit to be feedback linearizable. This is referred to as transverse feedback 
linearization. In |10| . Nielsen and one of the authors generalized Banaszuk and Hauser's results to 
more general controlled-invariant sets. In [11], the same authors developed a theory of transverse 
feedback linearization for multi- input systems. The latter can be viewed as a geometric approach 
to set stabilization. 

The notion of passivity for state space representations of nonlinear systems, pioneered by 
Willems in the early 1970's, |12l I13j . was instrumental for much research on nonlinear equilibrium 
stabilization. Key contributions in this area were made in the early 1980's by Hill and Moylan 
in |14} 115 1 IT6l 117] . and later by Byrnes, Isidori, and Willems, in their landmark paper |18j . More 
recently, in a number of papers [El [201 [21], Shiriaev and Fradkov addressed the problem of stabi- 
lizing compact invariant sets for passive nonlinear systems. Their work is a direct extension of the 
equilibrium stabilization results by Byrnes, Isidori, and Willems in [18] . 

The passivity paradigm is particularly successful for stabilization because it provides a useful 
interpretation of the control design process in terms of energy exchange, a view which makes the 
control design more intuitive, and allows one to naturally handle interconnections of dynamical 
systems. This view is at the centre of much research on stabilization of Euler-Lagrange control 
systems and, more generally, port-Hamiltonian systems; we refer the reader to the books by Ortega 
et al. [22] . A.J. van der Schaft [23], and the paper [23] . 




In this paper we develop a theory of set stabilization for passive systems which generalizes the 
equilibrium theory of [18] . as well as the results in [19\ [20l I21j . We investigate the stabilization 
of a closed set T, not necessarily compact, which is open-loop invariant and contained in the zero 
level set of the storage function. Our results answer this question: when is it that a passivity-based 
controller makes T stable, attractive, or asymptotically stable for the closed-loop system? Even in 
the special case when T is an equilibrium, our theory yields novel results, among them necessary and 
sufficient conditions for the passivity-based asymptotic stabilization of the equilibrium in question 
without imposing that the storage function be positive definite. The theory in [18], and [T9| 120" ! |2T] 
does not handle this situation. 

At the heart of the solution of the set stabilization problem lies the following reduction problem 
for a dynamical system £ : x = f(x): Consider two closed sets T and O, with Y C O, which are 
invariant for S; suppose that V is stable, attractive, or asymptotically stable for the restriction of 
£ to O. When is it that V is stable, attractive, or asymptotically stable with respect to the whole 
state space? 

The above reduction problem, originally formulated by Seibert and Florio in 1969-1970 [25J, 
[26] . is fundamentally important in control theory, as it often arises whenever one wants to infer 
stability properties of a control system based on its properties on a subset of the state space. The 
investigation of the stability of cascade-connected systems (see [27l Theorem 3.1], [28j Corollary 
5.2], [29] Theorem 10.3.1, Corollaries 10.3.2, 10.3.3]) and the development of a separation principle 
in output feedback control are examples of situations where one faces the same kind of question. 
Seibert and Florio in [30] investigated the general setting of dynamical systems on metric spaces, 
and found reduction principles for stability and asymptotic stability of compact sets. The second 
main contribution of this paper is the development of a new reduction principle for attractivity, 
and the extension, in the finite-dimensional setting, of Seibert and Florio's reduction principles to 
the case of closed, but not necessarily compact, sets. 

The paper is organized as follows. In Section [2] we present stability definitions and review 
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basic notions used in this paper, in particular the concept of prolongational limit set. We then 
present the stabilization and reduction problems solved in this paper. In Section [3] we present novel 
reduction principles for attractivity and asymptotic stability (Theorems 13. II and I3.2p of closed sets. 
As a corollary of these results, we give a stability criterion for cascade-connected systems which 
generalizes well-known results in the literature (Corollary I3.3|) . In Section 0] we review previous 
results on passivity-based stabilization and apply our reduction principles to the set stabilization 
problem for passive systems, giving conditions for asymptotic stabilization (Theorem I4.14p . Our 
result relies on a notion of 'T-detectability" which encompasses detectability notions used in |18j 
and [19 1 120 |, [21] . The relationships between these notions are explored in Lemmas 14.91 and 14. 101 In 
Proposition 14.121 we present sufficient conditions for T-detectability Finally, in the appendix we 
present the proofs of several technical results. 

2 Preliminaries and Problem Statement 

In this paper we consider control-affine systems described by 

m 

x = f(x) + ^2gi(x)ui 

i=i (1) 

y = K x ) 

with state space X C R n , set of input values U C R m and set of output values y C R m . The set X 
is assumed to be either an open subset or a smooth submanifold of R n . We assume that / and Qi, 
i = 1, . . . m, are smooth vector fields on X , and that h : X — > y is a smooth mapping. 

2.1 Notation 

Let R + denote the positive real line [0, +oo). Given either a smooth feedback u(x) or a piecewise- 
continuous open- loop control u(t) : R + — > U, we denote by 4> u (t, xo) the unique solution of (pQ) with 
initial condition xq. By (f)(t,xo) we denote the solution of the open-loop system x = f(x) with 
initial condition xq. Given an interval I of the real line and a set S G X, we denote by <ft u (I, S) the 
set cp u (I,S) := {(j) u (t,xo) : t G I,xq G S}. The set 4>(I,S) is defined analogously. 

Given a closed nonempty set S C W 1 , a point x G M n , and a vector norm || • || : M. n — > R, the 
point-to-set distance ||x||s is defined as \\x\\s ■= inf { || x — y\\ : y € S}. Given two subsets Si and 
S2 of X, the maximum distance of Si to S%, d(Si,S2), is defined as d(Si,S2) '■= sup{||x||s 2 : x G 
Si}. The state space X, being a subset of M. n , inherits a norm from M. n , which we will denote 
|| • || : X — > R. For a constant a > 0, a point x E X, and a set S C X, define the open sets 
B a {x) = {y G X : \\y — x\\ < a} and B a (S) = {y G X : \\y\\s < «}• We denote by cl(<5) the 
closure of the set S, and by M(S) a generic open neighbourhood of S, that is, an open subset of 
X containing S. We use the standard notation LfV to denote the Lie derivative of a C 1 function 

V along a vector field / on X, and dV(x) to denote the differential map of V. We denote by ad/ g 
the Lie bracket of two vector fields / and g on X, and by adj g its fe-th iteration. 

2.2 Passivity 

Throughout this paper it is assumed that ([T]) is passive with smooth nonnegative storage function 

V : X — > R, i.e., V is a C r (r > 1) nonnegative function such that, for all piecewise-continuous 
functions u : [0, 00) — ► U, for all xq G X, and for all t in the maximal interval of existence of 
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V(Mt,x ))-V(x ) < / u(T) T y( T )dT, 



(f>u(-,X ), 



where y(t) = h((f> u (t, xq)). It is well-known (see [H]) that the passivity property above is equivalent 
to the two conditions 

(Vx G X) L f V{x) < and L g V(x) = h(x) T , (2) 

where L g V denotes the row vector [L gi V ■■■ L gm V\. Our main objective is to investigate the 
stabilization of closed sets by means of passivity-based feedbacks of the form 



u = —ip(x), with <£>(■) 



h(x)=0 



0, h(x) T (p(x) 



>0, 



(3) 



where if : X — > U is a smooth function. The class of passivity-based feedbacks in J3]) includes that 
of output feedback controllers u = —cp(h(x)) commonly used in the literature on passive systems. 



2.3 Set stability and attractivity 

We now introduce the basic notions of set stability and attractivity used in this paper. All definitions 
below, except that of a uniform semi-attractor, are standard and can be found in [31] . Let T C X 
be a closed positively invariant for a dynamical system 

E:x = f(x), x £ X. (4) 

Definition 2.1 (Set stability and attractivity). (i) T is stable for £ if for all e > there exists 
a neighbourhood M{T) such that ^(R + ,Af(T)) C B £ (T). 

(ii) r is a semi-attractor for £ if there exists a neighbourhood M(T) such that, for all xq € N(T), 
lim^oo ||0(t,x o )||r = 0. 

(hi) r is a global attractor for S if it is a semi-attractor with M(T) = X. 

(iv) r is a uniform semi-attractor for S if for all x G T, there exists A > such that, for all e > 0, 
there exists T > yielding <jf>([T, +oo), B\{x)) C B e (r). 

(v) r is a [globally] semi- asymptotically stable for S if it is stable and semi-attractive [globally 
attractive] for X. 

Remark. If T is a compact positively invariant set, then the concepts of stability, semi-attractivity, 
and semi-asymptotic stability are equivalent to the familar e-5 notions of uniform stability, attrac- 
tivity, and asymptotic stability found, e.g., in [32\ Definition 8.1]. Moreover, in the compact case, 
the notion of uniform semi-attractivity is equivalent to that of uniform attractivity used, e.g., in [33] . 
In the non-compact case, however, the notions of asymptotic stability and uniform attractivity are 
much stronger than semi-asymptotic stability and uniform semi-attractivity. For instance, the do- 
main of attraction of an asymptotically stable set must contain a neighbourhood of T of the form 
Bg(T) (a "tube" of constant radius), while the domain of attraction of a semi-attractor does not 
have to contain such a neighbourhood, as its "width" may shrink to zero at infinity. 

Definition 2.2 (Relative set stability and attractivity). Let O C X be such that OnT ^ 0. We say 
that r is stable relative to O for S if, for any e > 0, there exists a neighbourhood N(T) such that 
jV(r) Pi O) C B £ (T). Similarly, one modifies all other notions in Definition 12.11 by restricting 
initial conditions to lie in O. 
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Definition 2.3 (Local stability and attractivity near a set). Let T and O, T C O C X, be positively 
invariant sets. The set O is locally stable near V if for all x € T, for all c > 0, and all e > 0, there 
exists 5 > such that for all xq € -B^fT) and all t > 0, whenever <^([0, t],xo) ^ B c (x) one has that 
</>([0, t], xo) C B e (0). The set is locally (semi-) attractive nearT if there exists a neighbourhood 
M{T) such that, for all x € A/"(r), (f>(t,x ) -> O at i -> +oo. 




Figure 1: An illustration of the notion of local stability near T 

The property of local stability can be rephrased as follows. Given an arbitrary ball B c (x) 
centred at a point x in T, trajectories originating in B c (x) sufficiently close to T cannot travel far 
away from O before first exiting B c (x); see Figured) It is immediate to see that if V is stable, then 
O is locally stable near T. 

Definition 2.4 (Local uniform boundedness). The system £ is locally uniformly bounded near V 
if for each x € T there exist positive scalars A and m such that </>(M + , B\(x)) C B m {x). 

Remark. If V is a stable compact set, then S is locally uniformly bounded near V. For, the 
stability of V implies the existence of a compact neighbourhood S of V which is positively invariant 
for E. Let A > and m > be such that, for all x € T, B\(x) C S C B m (x) (A and m exist 
by compactness). Then, for any x £ V, the ball B\(x) is contained in S 1 , and thus by positive 
invariance, </>(M + , B\{x)) C S C B m (x). 

The next lemma, proved in Appendix |Aj clarifies the relationship between uniform semi- 
attractivity and semi-asymptotic stability. It is used in Section 14.21 and Appendix [Dj 

Lemma 2.5. Let I be a closed set which is positively invariant for £ in and let U D T be 
a closed set. If T is a uniform semi-attractor [relative to U], then it is semi-asymptotically stable 
[relative to U}. Furthermore, if S is locally uniformly bounded near T, then V is semi-asymptotically 
stable [relative to U] if, and only if, it is a uniform semi-attractor [relative to U}. 



2.4 Limit Sets 

In order to characterize the asymptotic properties of bounded solutions, we will use the well-known 
notion of limit set, due to G. D. Birkhoff (see [34]), and that of prolongational limit set, due to 
T. Ura (see [35J). Given a smooth feedback u(x) and a point xo € X, the positive limit set (or 
w-limit set) of the closed- loop solution (f> u (t,Xo) is defined as 

L t(xo) ■= {? G X : (3{t n } C R + )t n -> +oo, M x o^n) ^p}- 

The positive limit set of the open-loop solution (f)(t,xo), defined in an analogous way, is denoted 
L + (xq). The negative limit sets (or a-limit sets) L^(xq) and L~(xq) of <p u (t,xo) and (j)(t,xo), 
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respectively, are defined using time sequences diverging to — oo. We let L+(S) := \J xo£S L+(xo) 
and I.-(S): \J XQeS L+ (x ) . 

The prolong ational limit set J+(xo) of a closed-loop solution 4> u (t,xo) is denned as 

J+(x ) := {pe X : (3{(x n ,t n )} C X x R+), x n -> x , t n -> +00, 4> u (x n ,t n ) -> p}. 

IiU <Z X and xo G cl(£7), the prolong ational limit set of <j> u (t, xq) relative to U is defined as 

J+(x , {/) := {p G : (3{(x n ,t n )} C f7 x M + ), x n -> x , i n -> +00, u (x n ,t n ) -> p}. 

The corresponding prolongational limit sets of an open-loop solution cj)(t, xq) are denoted by J + (xq) 
and J + (xq,U). We let J^(S) := Ua^eS ^O^o)) an d in an analogous manner we define J + (S), 
J+(S,U), and J+(S,U). 

Obviously, L+(xo) C J+(xo) and L + (xo) C J + (xo). Moreover, if xo € cl(C7), then 

L+(x ) C J+(x , 17) C J+(x ), 7+(x ) C J + (x , C/) C J + (x ). 

Proposition 2.6 (Theorem II. 4. 3 and Lemma V.1.10 in [36J). Consider the dynamical system E 
in For any x G X, J + (x) is closed and invariant. Moreover, for any u € L + (x), J + (x) C J + (a;). 

The results in Proposition 12.61 still hold if one replaces J + (x) by J" l "(x, U), with U C X. While 
L + (xo) is used to characterize the asymptotic convergence properties of <j>(t,xo), J + (xo) is used 
to characterize uniform convergence, as shown in the next result, which is used in Section [4.21 to 
determine sufficient conditions for r-detectability. 

Proposition 2.7. Suppose that S in ([3D is locally uniformly bounded near a closed and positively 
invariant set T. Let U C X be a closed set, V C U. Then, for each x in some neighbourhood of 
r, J + (x) 7^ [J + (x, U) 7^ 0]. Moreover, T is a uniform semi-attractor [relative to £7] for E if, and 
only if, there exists a neighbourhood 7V(T) such that J+(jV(r)) C T [J + (N(T), U) C T\. 

The proof of sufficiency can be found in Appendix [Bj while that of necessity is omitted because 
it is not used in the sequel. An analogous result holds for compact sets without the local uniform 
boundedness assumption, see Proposition V.1.2 in [36j . 



2.5 Stabilization and reduction problems 

The main objective of this paper is the stabilization of a closed set T using passivity-based feedback. 

Problem 1 (Set Stabilization). Given a closed set T C V~ (0) = {x G X : V(x) = 0} which 
is positively invariant for the open-loop system in ([1]), and given a passivity-based feedback of 
the form ((3|), find conditions guaranteeing that T is [globally] semi-asymptotically stable for the 
closed-loop system. 

The rationale behind passivity-based feedback is the following. Using (|2|) and the properties of 
the passivity-based feedback ([3]), the time derivative of the storage function V along trajectories of 
the closed-loop system formed by (P) with feedback ([3]) is given by 

dV^utP, so)) = Lf V(Mt, so)) ~ L g V(Mt, x Q )MMt, xq)) 

< -h((j) u (t, x )) J (p((f> u (t, x )) < 0. 

Thus, a passivity-based feedback renders the storage function V nonincreasing along solutions of 
the closed-loop system. One expects that if the system enjoys suitable properties, then the storage 
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function should decrease asymptotically to zero and the solutions should approach a subset of 
V _1 (0), hopefully the set T. 

Our point of departure in understanding what system properties yield the required result is the 
well-known property, found in the proof of Theorem 3.2 in [18], that, for all xq S X, the positive 
limit set L+(xq) of the closed- loop system is invariant for the open-loop system and such that 
L+(xq) C /i -1 (0). Let O denote the maximal set contained in /i _1 (0) which is invariant for the 
open-loop system. In light of the property above, if L^{xq) is non-empty, then it must be contained 
in O. Therefore, all bounded trajectories of the closed-loop system asymptotically approach O. 
Since LtV < 0, V is nonincreasing along solutions of the open-loop system, and so y _1 (0) is an 
invariant set for the open-loop system. Moreover, since V is nonnegative, any point x G V _1 (0) is 
a local minimum of V and hence dV(x) = 0. Therefore, L g V(x) = h(x) T = on V -1 (0), and so 
T C y _1 (0) C fo _1 (0). Since V -1 (0) is invariant and contained in /i _1 (0), it is necessarily a subset 
of O (this implies that O is not empty). Putting everything together, we conclude that 



It is then clear that if the trajectories of the closed- loop system in a neighbourhood of V are 
bounded, the least a passivity-based feedback can guarantee is the semi-attractivity of O; but this 
is not sufficient for our purposes. Notice that, on O, </?(•) = and so the closed- loop dynamics on O 
coincide with the open-loop dynamics. In particular, then, O is an invariant set for the closed-loop 
system. In order to ensure the property of semi-asymptotic stability of T, the open-loop system 
must enjoy the same property relative to O. Therefore, a necessary condition for V to be semi- 
asymptotically stable for the closed-loop system is that V be semi-asymptotically stable relative to 
O for the open- loop system. Is this condition also sufficient or are extra-properties needed? As 
discussed in the introduction, the question we have just raised is fundamental in control theory, 
as it often arises whenever one wants to infer stability properties of a control system based on its 
properties on a subset of the state space. It is then worth formalizing this problem and investigating 
it in its generality. 

Problem 2 (Reduction Problem, [25], [26]). Consider the dynamical system £ in @. Let V and O 
be two closed positively invariant sets such that r C O C X. Assume that V is, respectively, stable, 
semi-attractive, and semi-asymptotically stable relative to O. Find what additional conditions are 
needed to guarantee that V is, respectively, stable, semi-attractive, and semi-asymptotically stable 
for E. We also seek to solve the global version of each of the problems above. 

Problem [2] was originally formulated by P. Seibert and J.S. Florio in 1969-1970. Seibert and 
Florio developed reduction principles for stability and asymptotic stability (but not attractivity) for 
dynamical systems on metric spaces assuming that T is compact. Their conditions first appeared 
in [25] and [26], while the proofs are found in |30j (see also the work in [37] for related results). 
In the next section, we present novel reduction principles for semi-attractivity and, for the case of 
unbounded T, semi-asymptotic stability (a reduction principle for stability is found in Appendix |D|) . 
Using these reduction principles, in Section 0] we solve Problem [TJ 

3 Reduction principles 

In this section we focus on the reduction problem, Problem [2j and we put aside until Section [4] the 
investigation of the original set stabilization problem, Problem [TJ Consider the dynamical system 



r C F _1 (0) CO C /i _1 (0). 



(6) 



S : x = f{x), x G X, 



(7) 
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with / locally Lipschitz on X, and let T and O, T C O C X, be closed sets which are positively 
invariant for system E. As pointed out earlier, Seibert and Florio developed reduction principles for 
stability (see Theorem 3.4 in [30 j ) and asymptotic stability (see Theorem 4.13 and Corollary 4.11 
in [30]). Here, we present a novel reduction principle for semi-attractivity (Theorem I3.1j) and a 
reduction principle for semi-asymptotic stability (Theorem 13. 2\i which extends Seibert and Florio's 
result to the non-compact case. A consequence of our reduction principles is a novel stability result 
for cascade-connected systems, presented in Corollary 13.31 

Theorem 3.1 (Reduction principle for semi-attractivity). Let T and O, T C O C X, be two closed 
positively invariant sets. Then, T is semi-attractive if the following conditions hold: 

(i) r is semi-asymptotically stable relative to O 

(ii) O is locally semi-attractive near T, 

(iii) there exists a neighbourhood M(T) such that, for all initial conditions in Af(T), the associated 
solutions are bounded and such that the set cl(<j!>(IR + , A^(r))) n O is contained in the domain 
of attraction of T relative to O. 

The set V is globally attractive if: 

(i) ' r is globally semi-asymptotically stable relative to O, 

(ii) ' O is a global attractor, 

(iii) ' all trajectories in X are bounded. 

Conditions (ii) and (ii') are also necessary. The proof of this theorem is found in Appendix [Cl 
Part of the proof was inspired by the stability results using positive semidefinite Lyapunov functions 
presented in [38J and by the proof of Lemma 1 in |39j . 

Remark. Being of a rather technical nature, Assumption (iii) is difficult to check and of limited 
practical use. It has, however, theoretical significance because it is used to prove the reduction prin- 
ciple for semi-asymptotic stability stated in the sequel. A similar, but slightly stronger, assumption 
is found in Theorem 10.3.1 in [29] concerning the attractivity of equilibria of cascade-connected 
systems. In fact, the result in [29] is a corollary of Theorem 13.11 If condition (i) is replaced by 
the stronger (i)', then one can replace (iii) by the simpler requirement that trajectories in some 
neighbourhood of T be bounded. 

It is interesting to note that it is not enough to assume, in place of condition (i), that T is a 
semi-attractor relative to O (or, in place of condition (i)', that T is a global attractor relative to 
O), as the next example shows. 

Example. Consider the following system 

xi = (x\ + X3X-X2) 
X2 = {x 2 2 + xl){xi) 
£3 = -xl- 

Let T = {(xi,X2,X3) : X2 = X3 = 0} and O = {(x\, X2, x$) : X3 = 0}, both invariant sets. Obviously, 
O is global attractor (in fact, it is globally asymptotically stable). The system dynamics on O take 
the form 

x\ = -x 2 (xl) 
x 2 = xi(xl). 
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On r C O, every point is an equilibrium. Phase curves on O off of V are concentric semicircles 
{xf +x\ = c}, and therefore T is a global, but unstable, attractor relative to O. For initial conditions 
xq not in O, the trajectories are bounded and their positive limit set L + (xq) is a circle inside O 
which intersects T at equilibrium points. Thus, 4>(t, xq) V because L + {xq) (£_ T. This is illustrated 
in Figure [2J This example shows that if all assumptions in Theorem 13.11 are satisfied except the 
relative stability requirement in condition (i), then the attractivity of T cannot be guaranteed. 



Figure 2: T is globally semi-attractive rel. to O, O is globally asymptotically stable, and yet T is 
not semi-attractive. 

The next semi-asymptotic stability result relies, in part, on the reduction principle in Theo- 
rem [37TJ 

Theorem 3.2 (Reduction principle for semi-asymptotic stability). Let T and O, T C O C X, be 
two closed positively invariant sets. Then, T is [globally] semi-asymptotically stable if the following 
conditions hold: 

(i) r is [globally] semi-asymptotically stable relative to O, 

(ii) O is locally stable near T, 

(iii) O is locally semi-attractive near Y [O is globally attractive], 

(iv) if r is unbounded, then £ is locally uniformly bounded near T, 

(v) [all trajectories of S are bounded.] 

Conditions (i), (ii), and (iii) above are necessary. If T is a compact set, then the above theorem 
is equivalent to the results presented in Theorem 4.13 and Corollary 4.11 in [30] . 

Proof. We prove the theorem assuming that T is unbounded, since the compact case is already 
covered by Theorem 4.13 and Corollary 4.11 in [30]. In Appendix [Dj we show that assumptions (i), 
(ii), (iv) imply that T is stable. By Theorem 13 .1\ the global version (i.e., including statements in 
square brackets) of assumptions (i), (iii), and (v) imply global attractivity, and hence global semi- 
asymptotic stability. To prove that the local version of the assumptions imply semi-asymptotic 
stability of T, we need to show that assumption (iii) in Theorem 13.11 is satisfied. 

By assumption (i), T is semi-attractive relative to O. Let N C O denote the domain of attraction 
of r relative to O. By assumption (iv), for each x € T there exist two positive numbers X(x) and 
m(x) such that </)(M + , B X ( x )(x)) C B m ^(x). Fix x G T, and let e(x) > be small enough that 




-2 



-2 



ci (B £{x) (r)nB m(x) (x))nOcN. 
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The constant e is guaranteed to exist because the set on left-hand side of the inclusion is compact 
and can be made arbitrarily small. Since T is stable, there exists a neighbourhood J\f x (T) such that 
0(R+,A4(r)) C B £(x) (T). Now define 

u= |J %(i)n^(r). 

Clearly, J7 is a neighbourhood of T. By definition, for each y £ U, there exists £ € F such that 
y € B X ( x )(x) H A4(r), so that the solution originating in y is bounded and 

<f>(R + ,y) c £ £(x .)(r)n 

Therefore, cl(0(R+,y)) nOCcl (-B^T) n B m(a .)(a;)) flOciV. □ 

As remarked earlier, the usefulness of reduction principles is not limited to the stabilization 
of closed sets for passive systems. As a matter of fact, stability theorems for cascade-connected 
systems of the form 

x = f(x,y) ^ 

y = g{y), 

well-known in the control literature (see |27t Theorem 3.1], |28|, Corollary 5.2], |29t Corollaries 
10.3.2, 10.3.3]), are consequences of Seibert and Florio's reduction theory, specialized to the case 
when r is the origin and O = {(x,y) : y = 0}. Motivated by this observation, we present a 
straightforward application of Theorem 13.21 which has independent interest. 

Corollary 3.3. Consider system ([8]), with x G R ni , y G M" 2 , and let T C R™ 1 be a positively 
invariant set for system x = f(x,0). Suppose that <?(0) = 0. Then, T := {(x,y) : x £ T, y = 0} is 
[globally] semi-asymptotically stable for (JSj) if the following conditions hold: 

(i) r is [globally] semi-asymptotically stable for x = f(x,0), 

(ii) y = is a [globally] asymptotically stable equilibrium of y = g(y), 

(iii) if r is unbounded, then ([8]) is locally uniformly bounded near T, 

(iv) [all trajectories of ([8j) are bounded.] 



4 Passivity-based set stabilization 

We now return to the passive control system ([1]) and apply the reduction principles presented in 
Section [3] to solve Problem [TJ First, we review the main stabilization results for passive systems 
available in the literature. 



4.1 Previous results 

When the storage function V is positive definite, and T = 1/ _1 (0) = {0} is an equilibrium, the most 
general stabilization result is that by Byrnes, Isidori, and Willems in [18] ; it relies on the following 
notion of detectabilitjQ. 

1 The zero-state detectability definition in |18] uses the slightly stronger condition h((j>(t, xo)) = for alH > => 
<f)(t,Xo) — > 0. Our relaxation of the definition has no effects on any of the results in [18] . 
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Definition 4.1 (Zero-state detectability). System (pQ) is locally zero-state detectable if there exists 
a neighbourhood U of such that, for all xq E U, 

h(4>(t, xq)) = for all i £ M =>- (f>(t, x ) — s> as t — > +oo. 

If U = X , the system is zero-state detectable. 

Note that the definition above involves open-loop trajectories. The work in [TS] provides suffi- 
cient conditions for detectability. Assuming that V is C r , r > 1, define the distribution 

V = span{ad^ g t : < k < n - 1, 1 < i < m}, (9) 

and the set 

S = { x e X : L j f L T V(x) = 0, for all t eV, and all < j < r}. (10) 

Proposition 4.2 (Proposition 3.4 in p2]). If S D L + (X) = {0} and is proper and positive 
definite, then system ([I]) is zero-state detectable. 

Theorem 4.3 (Theorem 3.2 in [H]). Suppose that the storage function V is positive definite and (pQ) 
is locally zero-state detectable. Then any passivity-based feedback of the form ([3|) asymptotically 
stabilizes the equilibrium x = 0. Moreover, if V is proper (i.e., all its sublevel sets are compact) 
and (HJ) is zero-state detectable, then the passivity-based feedback globally asymptotically stabilizes 
x = 0. 

In a series of papers, [19l [201 [21] , Shiriaev and Fradkov extended Theorem 14.31 to the case when 
r is compact and F = y _1 (0), relying on the following notion of detectability. 

Definition 4.4 (V-detectability). System ([TJ is locally V -detectable if there exists a constant c > 
such that for all xo £ y _1 ([0,c]), 

h((f>(t, xq) = for alU G R => x )) -» as i -> +oo. 

If c = oo, the system is V -detectable. 

Proposition 4.5 (Theorem 10 in |20j). If S n L + (A') C y _1 (0) and is proper and positive 
semi-definite, then system ([T]) is F-detectable. 

Theorem 4.6 (Theorem 2.3 in |21j). Suppose that y _1 (0) is a compact set, and (pQ) is locally 
F-detectable. Then, any passivity-based feedback of the form ([3]) asymptotically stabilizes V~ l {Q). 
Moreover, if V is proper and ([1]) is ^-detectable, then the passivity-based feedback globally asymp- 
totically stabilizes F _1 (0). 

4.2 T-detectability and its characterization 

We now turn our attention to Problem [H For convenience, we repeat the definition of the set O 
given in Section 12.51 

Definition 4.7 (Set O). Given the control system ([1]), we denote by O the maximal set contained 
in /i _1 (0) which is invariant for the open-loop system x = f(x). 

When system (pQ) is linear time- invariant (LTI), the set O is the unobservable subspace. As 
discussed in Section [231 as long as the trajectories of the closed- loop system in a neighbourhood of 
T are bounded, a passivity-based feedback renders the set O semi-attractive. In order to guarantee 
semi-asymptotic stability of V C O, the reduction principle in Theorem 13.21 suggests that T should 
be semi-asymptotically stable relative to O for the open-loop system. We call this property T- 
detectability. 
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Definition 4.8 (T-detectability). System ([I]) is locally T -detectable if T is semi-asymptotically 
stable relative to O for the open-loop system. The system is T-detectable if T is globally semi- 
asymptotically stable relative to O for the open-loop system. 

Our notion of detectability is parameterized by T, and not by O, although the set O figures in 
its definition. This is due to the fact that O is entirely determined by the open-loop vector field 
/ and the output function h and, therefore, O is intrinsically related to the open-loop system. In 
the case of LTI systems, when T = {0}, the above definition requires that all tracjectories on the 
unobservable subspace O converge to 0. Therefore, in the LTI setting, T-detectability coincides 
with the classical notion of detectability. Further, the notion of T-detectability generalizes that of 
zero-state detectability. As a matter of fact, when V is positive definite, and thus T = {0}, the two 
detectability notions coincide. 

Lemma 4.9. If V is positive definite and T = V -1 (0) = {0}, then the following three conditions 
are equivalent: 

(a) System ([TJ is locally zero-state detectable [zero-state detectable], 

(b) the equilibrium x = is [globally] attractive relative to O for the open-loop system, 

(c) system ([1]) is locally T-detectable [T-detectable] . 

Proof. The set of points x$ £ X such that the open-loop solution satisfies h((j)(t, xo)) = is precisely 
the maximal open-loop invariant subset of /i _1 (0), i.e., the set O. Thus, conditions (a) and (b) are 
equivalent. Since (pQ) is passive, by we have LfV < 0. By the assumption that V is positive 
definite, it follows that x = is a stable equilibrium of the open-loop system. Thus, x = is 
[globally] asymptotically stable relative to O for the open-loop system if and only if x = is 
[globally] attractive relative to O for the open-loop system, proving that conditions (b) and (c) are 
equivalent. □ 

The next lemma shows that T-detectability also encompasses the notion of ^-detectability. 
Lemma 4.10. If T = V _1 (0) is a compact set, then the following three conditions are equivalent: 

(a) System ([I]) is locally ^-detectable, 

(b) the set T is attractive relative to O for the open-loop system, 

(c) system ([1]) is locally T-detectable. 

Moreover, if V is proper, then the global versions of conditions (a)-(c) are equivalent. 

Proof. Suppose that Q is locally V-detectable. Then, for all x € V -:l ([0,c]) n O, V(x(t)) -> 0. 
Since V -1 (0) is compact, in a sufficiently small neighbourhood of T, V~ l ((j){t, xq)) — > implies 
4>(t,xo) —s- y _1 (0), and thus T = F _1 (0) is attractive relative to O for the open-loop system, 
showing that condition (a) implies (b). Since LtV < 0, T is also stable for the open-loop system. 
Thus, condition (b) implies (c). Now suppose that dU) is locally T-detectable. Then, there exists a 
neighbourhood S of T such that, for all xq E SdO, <f)(t,xo) —>■ T. Since T = 1/ _1 (0) is compact and 
V is continuous, there exists c > such that y _1 ([0, c]) C S. Hence, for all xo € V r_1 ([0, c])nO or, 
equivalently for all xq G y _1 ([0,c]) such that h(<p(t,xo)) = 0, we have c/)(t,Xo) — > F _1 (0). By the 
continuity of V and the compactness of y _1 (0) the latter fact implies that V((p(t, xo)) — ► 0. This 
proves that condition (c) implies (a). 

The proof of equivalence of the global notions of detectability follows directly from the fact that 
if V is proper, then V(4>(t, xq)) — > if and only if 4>(t,xo) — > I/ -1 (0). □ 
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Despite their equivalence when T = 1/ _1 (0) is compact, the two notions of V- and ^-detectability 
have a different flavor, in that the latter notion utilizes the storage function V(x) to define a 
property of the open-loop system, detectability, which is independent of V. On the other hand, 
the definition of r-detectability, being independent of V, is closer in spirit to the original definition 
of zero-state detectability. Finally, the notion of ^-detectability cannot be generalized to the case 
when T is unbounded, even if T = V -1 (0), because in this case V(4>(t, xo)) -> no longer implies 
( j ) (t,x o )^V- 1 (0). 

We now give sufficient conditions for (TjQ) to be T-detectable that extend the results in Proposi- 
tions [42] and H31 Recall the definition of the set S in ©-CE]) and let 

S' = {x GX : Lfh(x) = 0, < m < r + n - 2}. 

Notice that the definition of S', unlike that of 5, does not directly involve the storage function (but 
recall that h T = L g V, so it does indirectly depend on V). The next result clarifies the relationship 
between S and S' . 

Lemma 4.11. Given any subset X C X , S' n L+(X) = S n L+(X). 

This result is interesting in its own right because it implies that the conditions in Propositions 14.21 
and 14.51 can be equivalently stated as S 1 n L + (X) C T. This condition can be checked without 
directly knowing the storage function. 

Proof. We show that (S'nL+(X)) C (Sf]L + (X)). Let x be an arbitrary point in S'(lL + (X). Since 
x is a positive limit point of an open-loop trajectory of ([I]), and since LfV < 0, then V(<p(t,x)) is 
constant and hence 

— = L f V{(j){t, x)) = 0. 

The identity LfV(4>(t, x)) = implies that LfV(4>(t,x)) is maximal. Therefore, dLfV(4>(t, x)) = 0, 
yielding L gi LfV(4>(t, x)) = 0. This and the fact that x £ S' give 

L {f , 0i] V(x) = L f L gi V(x)-L gi L f V(x) 
= L f L gi V{x) = Lfh(x) = 0. 

Next, notice that since L g .LfV((j)(t, x)) = 0, we have 

d m 

= —L 9i L f V(cf>(t,x)) = LfL gi L f Vm,x)), < m < r. 
Thus, for < m < r, 

LjL [fj9i] V(x) = Ly +1 L g% V(x) - LfL gt L f V(x) 
= Lj +1 hi(x) = 0. 

A simple extension of this argument leads to 

LfL T V(x) = 0, for all r <E D, < m < r, 

and thus x G S n L + (X). The proof that S n L + (X) C S' n L + (X) is almost identical and is 
therefore omitted. □ 
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Proposition 4.12. Suppose that all open-loop trajectories that originate and remain on S' are 
bounded and that the open-loop system in (pQ) is locally uniformly bounded near T. If 

s' nj + {s',s') cr, (n) 

then system ([TJ is T-detectable. Moreover, if V = F~ 1 (0), then condition (fTT|) may be replaced by 
the following one: 

S'nL+(S') C V~ l (0). (12) 

Proof. In order to show that T is globally semi- asymptotically stable relative to 0, it is sufficient 
to show that J + (0,0) C T. For, L+(0) C J+(0,0) C T implies that T is a global attractor. 
Moreover, J + (0, 0) C T implies, by Proposition 12.71 that T is a uniform semi-attractor relative to 
and so, by Lemma 12.51 it is stable. 

Since C /i _1 (0) is open-loop invariant, we have h(cj)(t,x)) = for all x G 0, and thus also 
L fh((f>(t, x)) = 0, for m = 0, 1, . . ., showing that C S' . 

It can be shown (see the proof of Proposition 3.4 in [18] . which is Proposition 14.21 in this paper) 
that L+(0) C S, and so L+(0) C S(1L + (S'). By LemmaHTEJ L+(0) C SnL+(S') = S f DL + {S'). 
Using condition (jlip or, when T = V (0), condition (|12p . we obtain 

l+(0) c s'ni + (5') c r. 

Since all open-loop trajectories contained in S' , and hence in 0, are bounded, the above inclusion 
implies that T is a global attractor relative to 0. Let p G be arbitrary. We next show that 
J + (p, 0) is compact. Let w € L + (p) C T. By local uniform boundedness of the open-loop system 
near T, there exist two positive scalars A and m such that 0(M + , B\(lu)) C B m (u>). By definition of 
prolongational limit set, for any 5 > 0, J + (u;, O) C cl ((/>(M + , -6,5(0;))). Taking 5 = A, we have that 
J + (cu, 0) C cl(B m (uj)). Thus, J+(w, 0) is a compact set. By PropositionEH J + (p, O) C J + (w, 0), 
and so J + (p, O) is a compact set as well. 

We claim that, for all p £ O, J + (p,0) C y _1 (0). Suppose that the claim is false. Then, 
by the compactness of J + (p, O), there exists y G J + (p,0) such that V(y) > 0. Put \i = V(y). 
Since y € J + (p, O), there exist two sequences {x^} C and {t^} such that — > p, — » +00, 
and ^(tfc,Xfc) —s- y. By the continuity of V, one can find K > such that, for all k > K, 
F(</>(ifc,Xfc)) > 3/i/4. Since p G and T is a global attractor relative to 0, 4>(t,p) — > T C y _1 (0). 
Since all solutions on are bounded and V is continuous, V(0(i,p)) — > and hence there exists 
T > such that, for all t >T, V(cj>(t,p)) < /u/4. Using again the continuity of V, there exists e > 
such that, for all x G B e ((j)(T,p)), V(x) < fx/2. Now, by continuous dependence on initial conditions, 
there exists 8 > such that, for all x G Bg(p), \\<fi(t,x) — (f>(t,p)\\ < e for all t G [0, T]. Since, for 
sufficiently large k > K, Xk G Bs(p) and tfc > T, we have U(c/>(ifc, x^)) > 3/^/4 > /i/2 > V(0(T, x^)) 
which contradicts the fact that LrV < 0, proving the claim. 

So far we have established that J+(0,0) C V _1 (0). If T = V -1 (0), we are done. If 
r C U _1 (0), we reach the desired conclusion by means of condition (lllj) as follows. Note that 
J+(0,0) C F _1 (0) C C 5', and, further, J+(0,0) C J + (5',5'). In conclusion, J+(0,0) C 
5' n J+(S', S') C T, as required. □ 

Remark. The natural way to check T-detectability is to compute the set in Definition 14. 7} and 
then assess the semi-asymptotic stability of T relative to 0. Should the computation of the set 
be too difficult, Proposition 14.121 above provides an alternative, but conservative, criterion for 
r-detectability that may prove useful in some cases. The example below illustrates this result. It 
is important to notice that condition (jlip may be hard to check in practice because it involves the 
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computation of the prolongational limit set J + (S' , S'). The conditions used in Propositions 14.21 
and 14.51 suffer from the same limitation because they too involve the computation of limit sets. 

Propositions 14.2 1 and 14.51 are corollaries of Proposition 14". 121 above. As a matter of fact, Propo- 
sition UJ21 relaxes the sufficient conditions for detectability found in [18] and [21]. To see this fact, 
note that, when V is proper and Y = y -1 (0), all trajectories of the open-loop system are bounded 
and system ([1]) is locally uniformly bounded with respect to T. Therefore, in this setting Proposi- 
tion states that a sufficient condition for T-detectability is the inclusion S' n L + (S') C V -1 (0). 
Since S' n L + (S') = S fl L + (S') C S n L + (X), this condition is weaker than the condition 
5 n L + (X) C V~ l (0) used in Propositions |42] and \£M 

Example. Consider the control system on X = M 5 

Xl = —Xl — X1X4 
X 2 = -X2 +X\—x\ 
X 3 = x 2 5 + Ui 
±4 = xf + e~ 1/x iU2 

X 5 = -X3X5 

(we set e~ 1 / x i\ X4 =o := 0) with output y = col \X3, x±e~ 1 l x 4\. This system is passive with storage 

V(x) = l/2(xf + x"l + x\ + xl). The goal set is T = {0}. It is not hard to see that S' = {x : x 3 = 
X4 = X5 = 0}. Let (xi(t), X2(t), 0, 0, 0) be any solution of the open-loop system lying in S' for all 
time. Since xi(t) = —xi(t) and xz{t) = —xz{b) + xi(t), any such solution is bounded. Next, we 
check condition (fTTj) . Pick any xo G S', i.e., xo = (xio, X20, 0, 0, 0), and consider the corresponding 
open-loop solution x(t). If xro 0> then x±(t) — > 00, and so J + (xo, S') = 0. On the other hand, if 
xio = 0, then we claim that J + (xo, S') = {0}. For, the equilibrium x = is globally asymptotically 
stable relative to the set {xi = X3 = X4 = X5 = 0}, and hence a uniform attractor relative to the 
same set. By Proposition 12.71 then, J + (xq,S') = {0}. In conclusion, 5' D J + (S",S") = {0}, and 
the system is T-detectable. 

In this example, T-detectability can be checked without using Proposition 14.12] since it is easily 
seen that the maximal open-loop invariant subset of /i~ 1 (0) is O = {xi = X3 = X4 = X5 = 0}. As 
noted above, {0} is globally asymptotically stable relative to this set. 

4.3 Solution to Problem [D 

In this section we solve the set stabilization problem, Problem [lj by presenting conditions that 
guarantee that a passivity-based controller of the form ([3]) makes T stable, attractive, or semi- 
asymptotically stable for the closed-loop system. All results are straightforward consequences of 
the reduction principles presented in Sectional and they rely on the next fundamental observation. 

Proposition 4.13. Consider the passive system ([1]) with a passivity-based feedback of the form ([3]), 
and the set O in Definition 14.71 Then, the set O is locally stable near T for the closed-loop system. 

Proof. Given arbitrary x in Y and c > 0, we need to show that 

(Ve > 0){35 > 0) s.t. (Vx G B*(T))(Vt > 0) u ([O,t],x o ) C B c (x) </> u ([Q,t],x ) C B £ {0). 
Let U = cl(B c (x)) and pick any e > 0. Define 

v := min{V(x) : x G U (1 {x : ||x||y-i( ) = e}, 
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and notice that v > because U D {x : ||sc||v-i(o) = ^} is compact and disjoint from V _1 (0). Using 
v, we define 

5 := min{||a;||v-i(o) : x £U Pi V' 1 ^)}. 

Since U PI is compact and disjoint from V _1 (0), then 5 > 0. Note that (5 < e for, if not, 

then we would have that 

(Vx G U n U -1 (») |M|y-i( ) > e, 
and this would contradict the definition of v. By the definitions of v and 5 it follows that 

unBs(v~\o)) cf/nr^o,!)]) c uns^Ho)). 

Since T C V -1 ^) C 0, for any i £ ^ we have \\x\\q < \\x\\y-ir \ < \\x\\r, and so B$(F) C 
BsiV" 1 ^)) and S e (y _1 (0)) C B e (0). By inequality © we have that all level sets of V are 
positively invariant for the closed-loop system. Putting everything together we have 

x eunB 5 (r) => x g f/nBj(y^(o)) x e [/nr^o^]) 

From the above, for any t > 0, the condition ^([0, i], xo) C C/ implies 

<K[o,t],x ) c [/ny- 1 !^]) c ^(^(o)) c s e (o), 

and thus O is locally stable near V for the closed-loop system. □ 

Theorem 4.14 (Semi-asymptotic stability of T). Consider system (pQ) with a passivity-based feed- 
back of the form (|3|). If T is compact, then 

• T is asymptotically stable for the closed-loop system if, and only if, system (JTJ) is locally 
T-detectable, 

• if all trajectories of the closed-loop system are bounded, then T is globally asymptotically 
stable for the closed-loop system if, and only if, system ^Q) is T-detectable. 

If r is unbounded and the closed-loop system is locally uniformly bounded near T, then 

• T is semi-asymptotically stable for the closed-loop system if, and only if, system ([T]) is locally 
T-detectable. 

• if all trajectories of the closed-loop system are bounded, then T is globally semi-asymptotically 
stable for the closed-loop system if, and only if, system (pQ) is T-detectable. 

Proof. The sufficiency part of the theorem follows from the following considerations. By Proposi- 
tion !4.13l O is locally stable near T. If T is compact, by Theorem ID . 1 1 local r-detectability stability 
of r. The stability of T and its compactness in turn imply that all closed-loop trajectories in some 
neighbourhood of T are bounded. Since all bounded trajectories asymptotically approach O, O is 
locally semi-attractive near V. If all trajectories of the closed-loop system are bounded, then O is 
globally attractive. Theorem 13.21 yields the required result. 

Now suppose that V is unbounded. By local uniform boundedness near V we have that all closed- 
loop solutions in some neighbourhood of T are bounded and hence O is locally semi-attractive near 
r. Once again, if all closed-loop trajectories are bounded, then O is globally attractive. The 
required result now follows from Theorem 13.21 
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The various necessity statements follow from the following basic observation. Any passivity- 
based feedback of the form (|3|) makes O an invariant set for the closed-loop system (see Section [23]). 
Therefore, if V is [globally] semi-asymptotically stable for the closed-loop system, necessarily V is 
[globally] semi-asymptotically stable relative to O for the closed-loop system. In other words, (pQ) 
is necessarily locally T-detectable [r-detectable] . □ 

We conclude this section with the following result, which gives conditions that are alternatives 
to the r-detectability assumption. 

Proposition 4.15. Theorem l4.14l still holds if the local r-detectability [r-detectability] assumption 
is replaced by the following condition: 

(i') r is stable relative to y _1 (0) and T is [globally] semi-attractive relative to O. 

We omit the proof of this proposition because it relies on essentially identical arguments as those 
used to prove the reduction principles in Theorems 13.11 and 13.21 If the sufficient conditions for T- 
detectability in Proposition 14. 121 fail, rather than checking for r-detectability one may find it easier 
to check condition (i') in Proposition 14.151 This is because verifying whether T is stable relative 
to does not require finding the maximal open-loop invariant subset O of h 1 (0); moreover, 

checking that T is semi-attractive relative to O amounts to checking the familiar condition 

h((j)(t,xo)) = (j)(t,xo) — > T as t — > +oo. 

Note that, in the framework of [18] and [21], the requirement that T be stable relative to V (0) is 
trivially satisfied because in these references it is assumed that T = V _1 (0). 

4.4 Discussion 

Theorems 14.31 and 14.61 dealing with the special case when T = y -1 (0) (= {0}) and T is compact, 
become corollaries of our main result, Theorem 14.141 We have already shown (see Lemmas 14.91 
and 14.10]) that in this special case the properties of zero-state detectability (when T = {0}), and 
^-detectability coincide with our notion of r-detectability. Therefore, Theorems 14.31 and 14.61 state 
that local r-detectability is a sufficient condition for the asymptotic stabilization of the origin using 
a passivity-based feedback. We have shown that actually this condition is also necessary. When the 
storage function is proper, Theorems 14.31 and 14.61 assert that r-detectability is a sufficient condition 
for the global stabilization of T by means of a passivity-based feedback of the form ([3]). If V is 
proper, then all trajectories of the closed-loop system are bounded, and so Theorem 14.141 gives the 
same result. Moreover, once again, the theorem states that r-detectability is necessary for the 
stabilizability of T by means of a passivity-based feedback. 

The theory in [18] and [21] does not handle the special case when T is compact and T C y _1 (0), 
while our theory does. This case includes the important situation when one wants to stabilize an 
equilibrium (r = {0}) but the storage is only positive semi-definite. Based on the results in [18] 
and [21] , it may be tempting to conjecture that Theorems 14.31 and 14.61 still hold if one employs the 
following notion of detectability: 

(Vx e M(T)) h((f>(t, x )) = for alU 6 R =^> <j)(t, x ) T, (13) 

which corresponds to requiring that O in Definition 14. 71 is a semi-attractor for the open- loop system. 
This conjecture is false: we have shown that (local) r-detectability (i.e., the semi-asymptotic 
stability of V relative to O for the open-loop system) is a necessary condition for the stabilization 
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of r. Even if one relaxes the asymptotic stability requirement and just asks for semi-attr activity of 
r relative to O, the above conjecture is still false. As a matter of fact, Theorem 13.11 suggests that 
even in this case (local) r-detectability is a key property. A counter-example illustrating this loss 
of semi-attractivity is the pendulum. The upright equilibrium is globally attractive, but unstable, 
relative to the homoclinic orbit of the pendulum. Despite the fact that a passivity-based feedback 
can be used to asymptotically stabilize the homoclinic orbit (see, e.g., [3D], [H], and the related 
work in |42j), the upright equilibrium is unstable for the closed-loop system. This well-known 
phenomenon finds explanation in the theory developed in this paper: the cause of the problem is 
the instability of the upright equilibrium relative to the homoclinic orbit. We next present another 
explicit counter-example illustrating our point. 

Example. Consider the control system with state (xi, X2, X3), 

r = — r(r — 1) 

= sin 2 (0/2)+x 3 
x 3 = u 

y = %h 

where (r, 9) G (0, +00) x S 1 represent polar coordinates for (xi,X2). The control system is passive 
with storage V(x) = x|/4. Let T be the equilibrium point {(xi, X2, X3) : x\ = 1, X2 = X3 = 0} and 
note that O = {(xi, X2, X3) : X3 = 0}. On O, the open-loop dynamics read as 




Figure 3: On the left-hand side, phase portrait on O for the open-loop system (|15p. On the 
right-hand side, closed-loop system (|14p with feedback u = —y. Note that T is not attractive. 

and it is easily seen that the equilibrium T attracts every point in O except the origin. Hence, T 
is attractive relative to O, but unstable (indeed, the unit circle is a homoclinic orbit of the equi- 
librium); see Figure [3j Therefore, condition (|13p holds but the system is not locally T-detectable. 
Consider the passivity-based feedback u = —y, which renders O globally asymptotically stable. 
Now for any initial condition off of O such that (xi(0), ^2(0)) 7^ (0,0), 23(0) > 0, the correspond- 
ing trajectory is bounded, but its positive limit set is the unit circle on O, and therefore it is not a 
subset of T; see Figure [3l In conclusion, T is not attractive for the closed-loop system (and neither 
is it stable). This example illustrates the fact that, when T C y _1 (0) is compact, simply requiring 
condition (|13|) in place of r-detectability may not be enough for attractivity of T. 
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In the light of Theorem 14.141 and the example above, it is clear that the addition of the stability 



requirement on T, relative to O, is a crucial enhancement to the notions of detectability in [18 




and [2TJ. 

5 Conclusions 

We have investigated the problem of stabilizing a closed set T which is open-loop invariant for a 
passive system, and contained in the zero level set of the storage function. Allowing T to be a 
subset of, and not necessarily coincide with the zero level set of the storage function adds great 
flexibility in control design. This point is illustrated through several examples in a companion 
paper [43] . In this paper we gave conditions for semi-asymptotic stability of T relying on the new 
notion of T-detectability. When T is compact, among other things we showed that r-detectability 
is both necessary and sufficient for the asymptotic stabilization of T by means of a passivity-based 
feedback. When T is unbounded, our results rely on the assumption that, near T, trajectories 
of the closed-loop system enjoy a type of boundedness property. Our theory crucially relies on 
three novel reduction principles for stability, semi-attractivity, and semi-asymptotic stability. We 
envision that these principles will be relevant to other problems in control theory. The investigation 
of semi-asymptotic stability in the presence of unbounded trajectories must necessarily rely on 
different tools than the ones used in this paper. Birkhoff's notion of limit set and Ura's notion 
of prolongational limit set are not applicable in this setting, and the same holds for the various 
reduction principles presented in this paper. 

A Proof of Lemma 12.51 

We first show that if T is a uniform semi-attr actor, then it is semi-asymptotically stable. Suppose, by 
way of contradiction, that T is unstable. This implies that there exists e > and sequences {x{\ C X 
and {t{} C M + , with ||xj||r — ► such that \\(f>(ti, Xi)\\r = e. By Lemma TP. 2} we can assume, without 
loss of generality, that {xi} is bounded and has a limit x E T. Using x and e in the definition of 
uniform semi-attractivity, we get A > and T > such that <p([T, +oo), B\(x)) C B £ (T). For 
sufficiently large i, Xi € B\{x) and therefore, necessarily, < ti < T. Having established that {^} 
is a bounded sequence, we can assume that t{ has a limit r < oo. Since T is positively invariant, 
4>{t,x) € T. This gives a contradiction since (p(ti,Xi) — > 4>(t,x) and, for all i, \\cfr(ti,Xi)\\r = £■ 

Next we show that if £ is locally uniformly bounded near T and T is semi-asymptotically stable, 
then r is a uniform semi-attractor for E. By Proposition 12.71 we need to show that there exists 
a neighbourhood Af(T) such that J + (7V(T)) C T. By local uniform boundedness, for all x in a 
neighbourhood of T, J + (x) ^ 0. Moreover, since T is a semi-attractor, by Proposition 12.61 we 
have J + {x) C J + (L + (x)) C J + (T). Therefore, to prove uniform semi-attractivity it is enough 
to show that J + (T) C T. Consider an arbitrary point x £ T, and let p € J + (x). By local 
uniform boundedness, there exist positive constants A and m such that B\(x)) C B m (x). 

By the definition of prolongational limit set, there exist sequences {x n } C X and {t n } C M + , with 
x n ► x and t n > +oo, such that (f>(t n , 

x n ) — > P- Without loss of generality, we can assume that 
{x n } C B\(x). Take a decreasing sequence {e n } C M + , with e n — > 0. By the stability of T, there 
exists a nested sequence of neighborhoods M n +i(T) C Af n (T) such that 4>(R + , M n (T)) C B £n (T). 
Since Af n (T) n B\(x) is a bounded set, for each n there exists 5 n > such that B$ n (T) n B\(x) C 
A/" n (r) n B\{x). We thus obtain a decreasing sequence {8 n }, S n — > 0, such that </>(M + , B$ n (x)) C 
B m (x)nB En (T). Take subsequences {x nk } and {B$ nk (x)} such that, for each k, x nk € B$ n ^ (x). Since 
x n — > x € T, for each n there are infinitely many x n 's in B$ n (x), and therefore the subsequences just 
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defined have infinite elements. We have that (f)(t nk ,x nk ) — > p and, by construction, (f)(t n .,x nh ) G 
jB En (r). This implies that p G T, and so J + (x) C I\ 

The proofs of the statements involving relative stability concepts are identical. □ 

B Proof of Proposition 12.7 

We only prove sufficiency. Assume that there exists a neighbourhood J\f(T) such that J + (7V(r)) C 
r. By local uniform boundedness, we can assume that all trajectories on Af(T) are bounded, and 
hence for each x G Af(T), L+(x) + 0. Since L+(Af(T)) C J + (N(T), U) C J + (N(T)), we have that 
for each x G M(T), J + {x) and J + (x, U) are not empty. To prove that T is a uniform semi-attractor, 
we need to show that, for all x G T, 

(36 > 0)(Ve > 0){3T > 0) s.t. <j>([T,+oo),B 6 (x)) C B £ (T). 

Suppose, by way of contradiction, that there exists x G T such that 

(V<5 > 0)(3e > 0) s.t. (VT > 0)(3x G Bs(x), 3t > T) s.t. \\(/)(i, x)\\ r > e. (16) 

By the local uniform boundedness assumption, there exist positive A and m such that ^>(M + , B\(x)) C 
B m (x). We can take small enough 6 that 6 < A and cl(B$(x)) C AA(r). Let e > be as in (|16p . Take 
a sequence {Tj} C M + , with Tj — > cxd. By (fT6l) . there exist sequences {xj} C Bg(x) and {tj} C M + , 
with tj — > oo, such that ||^(fi,^i)||r — £ - Since X{ G B$(x) C B\(x), then (p(xi,ii) G B m (x). By 
boundedness of {xj} and we can assume that x» — > x* G cl(5,5(x)), and <f>(ti,Xi) — > p, 

with ||p||r > e. We have thus obtained that there exists x* G c\(B§{x)) such that J + (x*) <f_ T. 
However, c\(Bs(x)) C M(F), and so J + (cl(i?5(x))) C T, a contradiction. 

The proof that T is a uniform semi-attractor relative to U if and only if there exists M(T) such 
that J+(A/"(r), U) C r is identical. 

□ 

C Proof of Theorem SU 

By assumption (ii), there exists a neighbourhood A/i(T) of V such that all trajectories originating 
there asymptotically approach O in positive time. Let A/2(T) be the neighbourhood in assumption 
(hi), and define Nz(T) = A/i(r) nA^T). Clearly, A/3(r) is a neighbourhood of T. By construction, 
for all xq G Af^r), the solution is bounded and approaches O. Therefore, the positive limit set 
L + (xq) is non-empty, compact, invariant, and L + (xq) C O. Moreover, by definition of positive 
limit set, and by assumption (hi) we have the following inclusion, 

L + (x ) C cl(0(lR + , x Q )) DO C {domain of attraction of T rel. to £>}. (17) 

We need to show that L + (xq) C T. Assume, by way of contradiction, that there exists to G L + (xq) 
and uj £ r. By the invariance of L + (xq), <p(M,uj) C L + (xq), and therefore L~(oj) C L + (xq). By the 
inclusion in (|17p . all trajectories in L~(uj) asymptotically approach V in positive time, and so since 
L~(u)) is closed, L~(w)nr^0. Let p e L~ (uj) OF . Pick e > such that ||cj||r > e. By the stability 
of T relative to O, there exists a neighbourhood Af 4 (r) of T such that 0(R + , jV 4 (r) nO)c B e (r). 
Since p G L~(u), there exists a sequence {i^} C M + , with t^. — > +00, such that (j)(—tk,u)) — > p at 
A; — > +00. Since p G T, we can pick k* large enough that <f>(—t}.*,ui) G A4(r). Let T = tk* and 
z = (j)(—tf.*,u). We have thus obtained that z G ^(r), but <j)(T,z) = us is not in B £ (T). This 
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contradicts the stability of T, and therefore, for all xq G A/s(r), L + (xq) C T, proving that T is a 
semi- attr actor for E. 

To prove global attractivity of T it is sufficient to notice that by assumptions (ii)' and (hi)', 
for all xq G X, L + (xq) is non-empty and L + (xo) C O. On O, by assumption (i)' all trajectories 
approach T, so by the contradiction argument above we conclude that L + (xq) cT, □ 

D Reduction principle for stability 

Theorem D.l. Let V and O, T C O C X, be two closed positively invariant sets. If assumptions 
(i), (ii), and (iv) of Theorem 13.21 hold, then T is stable. 

To prove the theorem, we need the next lemma. 

Lemma D.2. Let r C X be a closed set which is positively invariant set for E in ([7|). If T is 
unstable, then there exist e > 0, a bounded sequence {x^} C and a sequence {tj} C M + , such 
that Xj — > x G T, and ||0(tj, Xj)||r = £. 

Proof. The instability of T implies that there exists e > 0, a sequence {xj} C and a sequence 
C R + , such that ||xj||r — ► 0, and ||0(tj, Xj)||r = e. If we show that we there exists a bounded 
{xj} as above, then we are done. Let S be defined as follows 

S = {x G B e (r) : (3t > 0) \\<f>(x,t)\\ = e}. 

The instability of T implies that S is not empty. Moreover, since T is positively invariant, SnT = 0. 
Suppose that the lemma is not true. Then, for any bounded sequence {x^} C S, we have Xj -f* T. 
This implies that, for any x G T, there exists 5(x) > such that B^ x ){x) n 5 = 0. For, if this 
were not true, then there would exist a bounded sequence {x{\ C 5, with x, — > Y contradicting 
the assumption we have made. Let U = \J xer Bg( x \(x). By construction, U is a neighbourhood 
of r such that U D S = 0. In other words, for all x G U, there does not exist t > such that 
||<^(f,a?)[|r = e, contradicting the assumption that T is unstable. □ 

Proof of Theorem \D.1[ By way of contradiction, suppose that T is unstable. Then, by 
Lemma fD.2l there exist s > 0, a bounded sequence {xj} C with x» — > x G T, and a sequence 
{tj C R + , such that 

||0(ti,xi)||r = e, and 0([O, x^) G B e (T). 

By local uniform boundedness of E near T, there exist two positive numbers A and m such that 
0(M + , B\(x)) C B m (x). We can assume {xj} C B\{x). Take a decreasing sequence {ej} C M + , 
£j — > 0. By assumption (ii), O is locally stable near V. Using the definition of local stability 
with c = m and e = £j, there exists <5j > such that for all xq G Bs z (x) and all t > 0, if 
</>([0,i],xo) C B m (x), then 0([O, t],xo) C B £i {0). By taking <5j < A we have 

(VxoGB 5i (x)) </>(IR + ,xo) Cfl £i (0). 

By passing, if needed, to a subsequence we can assume without loss of generality that, for all i, 
Xi G Bst (x) so that 

limsup(i(</>([0,t i ],x fc ),e>) = 0. 

Using assumptions (i) and (iii) (if T is unbounded), by Lemma 12.51 it follows that T is a uniform 
semi-attractor relative to O. Therefore, 

(Vx G T)(3 / Li > 0)(Ve' > 0)(3T > 0) s.t. </>([T, +oo), B^x) n O) C B E ,{T). (18) 
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Consider the set r' = T n cl(B2 m (x)). Since T' is compact, using (fT8j) we infer the existence of 
\i > such that 

(Vx G r')(Ve' > 0)(3T > 0) </>([T, +00), B M (a?) n O) C B^(r). (19) 

By reducing, if necessary, e in the instability definition, we may assume that e < fi. Now choose 
e' < e/2. Using again a compactness argument, by (|19p one infers the following condition 

(3T>O)(VxGr , )0([T,+oo),S M (x)nO) cB e /(r). (20) 

We claim that B^T) n £ m (x) C For, if \i > m, then 

fl B m (x) = B m {x) C C £^(r n el(£ 2m (x))) . 

If ^ < m, then x G B^(T) f] B m (x) if and only if ||x||r < A* and \\% — x\\ < m; in particular, there 
exists y G T such that \\x — y\\ < /x. Since \\y — x\\ < \\x — y\\ + \\x — x\\ < fj, + m < 2m, we have 
that y G T n cl(.B 2m (x)), and thus a; G 5 M (r n cl( J B 2m (x))). 
Using (|20p and the claim we've just proved we obtain 

(VxG^(r)n£ m Oc)ne>) 0([r,+oo),x) c b £ ,(t). (21) 

Now, since {t^} is unbounded there exists K\ > such that > T for all k > K\. Since 
0([O, tk), Xk) C -B e (r) we have </>(i& — T,Xk) G -B £ (r) for all > .fifi. Let 

2/fc = 4>(tk,Xk), and z fc = </>(*fc - T, x k ). 

Thus, yk = <j)(T,Zk), \\yk\\r = e and Zk G -B e (r). By local uniform boundedness, it also holds that 
Zk G B m {x). Pick (J £ (0,/i- e). Since Zk G </>([0, tk),Xk) C B m (x), and since 

limsupd((/>([0,t fc ],a; fc ),C') = 0, 

then there exists Ki > K\ such that, for all k > K2, there exists z' k G B m (x) n O such that 
— 411 < <5- Since Zk G £? e (r), then 

4 g b £+5 {t) n B m (x) noc B„(T) n B m (se) n o 

and, by (|2"T|) . 0([T, +00), 4) C £? e /(r). By continuous dependence on initial conditions, 6 can be 
chosen small enough that 

(Vs G 5 m (x))(Vx G fl,(z)) ||^(r,x) - 0(T,x o )|| < e/2. 
We have z k G B m (x) and ||^ — 411 < <^ hence \\(j>(T,Zk) — 4>{T,z' k )\\ < e/2, which implies 

y k s 5 £/2 (<kt,4)) c £ e/2+£ ,(r) c s 6 (r), 

contradicting [ [ 2/fc llr = £• D 
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